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ABSTRACT ^ • 

^ This report of the first-year operations of project 

PEAL {Relevant Experiences for Alternative Learning), an experience 
based career educatioii <EBCE) project based on the 'EBCE model 
developed by. Northwest Regional Educational Laboratories, is ^ 
presented in. four parts. (The thr^e^^broad characteristics of Project 
REAL follow: \student-centered and provided personalized , learning 
experiances to participating students; focus of student learning 
activities w*as* in the qommunity; and instructional experiences of an 
academic nature were integrated, with career developmrat experience^,). 
Section T includes, an introiduct ion to- the project goal^ and eicplains 
the scope of th^ evaluation* Section 2^ pertaining to studen^t 
^'outcomesr covers information bn' the students' perforioance level ^ 
the basic skill area?, .their j-bb knowledge, their knowle^dge of career 
decision- makinq r arid ^^heir- ability -to complete seven "survival 
skills" competencies. Section 3r pertai^ning to student' process 
objectivesr . reports information on studeQt placement in community % 
exploratory and. project learning activities, high scl\obl -<:i:edits 
earned^ student assessment, and implementation -of sex-fair guidance,. 
placSmentr counseling and follow-up services. Section 4 discusses 
implementation of *the project management plan, parental approval, 
insurance protection, staff development,, employment " of needed 
personnal, and establi-shment -of . an advisory board. (BM) . * 
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/ ' SECTION I . INTRODUCTION 
the Newark (Del) School' District has been awarded a three-year contract from 
the U.S. Office of Education to Implement an exper.ience based career, education ^ 
project^ (Ei3CE) s'ubsequeifitly referred to as Project REAL. As p^rt of-*the, terms 
and conditions of the contract* Educational Testing Service (ETs'^^as been \ , 
selected to provide thitd-fkaxty evaluation atitivities for the project's first 
year of operation ~ October i, 1976 to September* 31, ^1977.* •ETS/s specifications 
for third-party evaluation services weire included as* part of Newark's original 
proposal to the Office ^of-* Education. . ETS rece^^ved and signed a formal- letter of 
igreement (contract) to provide these services on November 30, 1976. 

Pro.^ect REAL ^ . ^ - ' \ l ' . " 

Experience based career education. was cpirceptualized**and, initiated'by the Office 

of Education. Following preliminary- studi^^s, four regional, Ipbor'atories were 

- ■ ' . * * I • " \ 

selected by the National Institute of Education 'to develop the cEBCE/concept into 

^ - ; \* . ^ . ^ , * ' * 

an alternative educational program for High school students.'* The mwark^chopl * 

' - ' ' • . ' • \ *\ ' * • 

District selected Northwest Regional Edpcationkl^Laboratayie^ EBCE project for . 
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impalement at ion. The project has essentially three broad- characteristic^; , 

1« The project is student-centered and provides personalized ^ 

learrfing experiences to participating students. 
2^ Th€L focus of /student learning acti^ties, is' in the community. 

3. Instructional experiences of an aca/temic nature ar6 integrated 

♦ **" ' . 1 

- * with career development experiences. _ ) 

The content of 'Project REAL's learning activities ^is individualized on the 

? , ' . * 

basis of each student's unique cognitive styles, personal goals and educational 

needs. Staff are guided in their negotiation of individual student learning 

plans 'by the followi^ig curriculum components: 



Life Skills (creative development, critical thinking, 
personal/sociarl development, science, functional citilzenship, 
competencies) - ' ^ ^ 



Basic Skills (reading, mathematics, computation) 



' • Career Development (identifying career interests, understanding 

* ' / 2 

, . ' * the world* of work, employability skills, career knowledge) 



1.* National Institute' of Education, Education and Work Program 
' . U.S. Department of Health, .pducatlon and Welfare, A C0mpari! 



/ 

son of Four 



Exp erienc^-Based^ Career. Education Programs , 1976. */ 

2. Newark, Delawar^^' A Proposal for the ifeplementatioil of Northwest Regional 
• Educational LaS^ra'tories EBGg Modfel, 1976. ; . . , ' , . " ' ' 
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The goals 'of Project REAL as, contained in the .proposal to the U.S. Office 
of E^ii^ation include; - ' ; ' ^ ^ - \ 

Of Qoal A: Pf-oviding the overall management and support staff for the 

program ^ * ^ , i > 

Al: Establishing an advisory board to function in* the areas of 
* program planning, governance and community relatipns 
A2: : Developing a management plan, for each years operation 
Goal B: Developing, the. ^necessary instructional and curriculum m^erials 
iot approximately .^Ojstj^dents for the sfirst 'year ofvoperation 

A. * , 

Bl: Establishing a network of community sites in which student 

Laarniog activities -will take ;plaGe ^ i-r'/^--" 

^. B2: .Implementing EDGE curriculum materials in thr^^ejfiigh schools* 
^ that relates community learning activities with the three 
' ' > program content ar-eas; Life SklWfs, Basld Skills .and Gareer 

Development. . ■ ' - 

^ \ ' « . . 

Goal C; > Ev-aluat^ng "student 'process and student outcome dat*a 

' " \ • . • , r - ^ 

CI: ^Developing and implemfentii\g an evaluation design that" provides • 

for student butcome,* evaluation, process evaluation, summative ^ 
' * . ' j) ' « ' - - 

evaluatlq;! and side effects evaluation ^ ' 

•Goal D: Developing alternative strategies for demonstrating and ^ ' 

disseminating Project REAL matei^lals through ^Delaware. ' ^ 

DjL': Providlajg consultant services and. appropriate materials to, 

• dlstri^cts interested in Implementing Project REAL , ^' 

D^i^-^Proyiding disseminatioiY''of PVoject, REAL information' through 
" ^ ' ^ * . , ~i \ '' \ > * 

gifadiiSte career and. vocational education courses offered -"at the 



t 



^Uhlversit/^of DelawaA' 



i 



1. Newark, 4)elavgre, ^A Bropos^al for tfie Implementation, of North West Regional 
Education Laboratfories EDGE Model ^ 1976^. ^ ' 



During Project^ REAL'S -first 'year of imRlementation 34 students were involved 

' • / " • ■ 

in the program in /Christiana; Glasgow and Slewark High Schools.' 'The first half of 
the.-sch.ool calenaai: year was devoted, to preparing the necessary instructional' and 

curriculum matetfials, recruiting students,' establishing lelarnihg centers, and 

J ' ' ' \ * * 

employing staff, Student involvement in the jprogra^ was ' initiated in January, 1977, 

Background of the Mstrict ' - " , " ' ^ ' ■ 

Newark, DeLki^are is^ located midway between the nation's* capitol and New York* 
^ity. Th4 city is e-xperienoing a massjve growth in industry 'and housing. It 
has progressed from a sraclll farming community to one" presently characterized by 
pollution, congestion^ and the demand for expanded services. typical of cities 
in/the northeast megalopolis'. The Newark S'chooi District ^s<^tu<Jent enrollment 
^has doubled every five years since World War II' and is currently estimated at 
17,000 students. The district encompasses about i5 percent of the state 
of Delaware's^ total .population. The Newark*. Dis trict ^is heterogenous in its ? 
occupational and spciocultural makeup with middle-ijicpm^, families predominating. 
A high proportion of the district's -workers are employed in' two broad areas;- ' 
' prodyction and scientific-technicals ■ * 

S cope of Evaluation . . ' . > 

The evaluation plan for Project REALM'S first year of implementation^ includes * t 

evaluation questions that are intended to d'eteniiine t^e extent to which: 

_ • Project REAL hdfe been implemented in accor-dance with i^s* proposal. ' 
• Student process objectives and product outcomes have been attained. 

■ • 4 » 

m Assurances specified by th^ United States Office of. Education have 
be,en achieved. . ^ . . ^ j 



The evaluatioiv plan was prepared -in three parts. Part* A of the plan lists 

evaluative questions related to student outcomes; Part B contains questions- about 

student process objectives; and Part C sp^•cifies questions linked to project* 

management tasks*. s|)ecif ically the fprmat^of the plan is as follows: 

' Evaluation Questions ; . .A aescription of * the topic or area " * '''' 

, evaluated in three brdad areas: . 

Patt- A Student' Outcome Evaluation Questions 

^ , - Part B - Student Process Evaluation*JQ\iestions ' ' i ' 

•Part C - Management Process Evaluation- Question^ * , * * 

\ • Data Sburce ; Lists data sources that will be tfsed to provide ^ 

information about' each evaluatJLon questi6ti . ^ \ 

~ , • »* ' » 

' Time Data Collected : Data collection time frame by Fall. Winter 
or Spring. ' ' • , • 

^9 Evaluation, Design : Specific type of design tp be used; 
Formative ' . . 

-"^umin^tive ' ^' . ^^^^^ 

- Pretest/Posttest; Ppsttest Only ^ / • ' 

• Analysis : Describes the .type of analysis to he* used, stich 
• * ^ ' ' .* . ■ 

as noun group comparison, analysis of variance or covatiance and * 



so on. • . 



• ^Target ^Criteria ; A description -of the criteria of standards to be 
-used to assess whether or not the 'evaluation question has been 

answered^in the desired direction . " ' 

• , Sample; ^ The^sajnple (or*. population) 'or subjects ox documents te-be. 
ar^alyzed. 



-6- 



) The ^ub§equent sections of the Final Report present discussion and ^ 
tahulation of^he results of Project REAL,'-s first annual evaluation. The 
sections are , presented consistent with the major parts of the evaluation 
• design. ♦ ^' ' % * . 



» '^SECTION 11.^ PROJECT REAL STUDENT OUTCOME EVALUATION QUESTIONS 



• gave Project REAL Students Maintained Their Performance Level in the "^sic &kill ' 



Areas ^ 



Th? basic premise 'of Project REAl*Is that project' stlident^ will perform in the 
basic skill areas as well as ^todejits enrolled, in traditional higTi school 

- .0 ^ ( 

programs. ' Analy-sis of the data oollect^d indicates tW although student 



perf orfiiance fluctuated in some .basic skill area, .their overall performance was 



'I 



-maintained. ". 

The California T§st of Basic Skills (CTBS) was_ administered to all project 
students using a pretest-post*:est design. Assessment of student achievement was' 
■detefminfed using the CTBS norming sample as the coitlparison group. Mean scores, 
percentiles and normalized curve' equivalents ,were computed for each of the ' " 
basic -skill^reas measure4 and are displayed in tables 1 through "6. ' The t;ables 
are-,broken-out by eleventh -^tid^ twelfth grad.e students, however.^he data wer« 
pooled across the three high schools participating in the project because of the 
small number of .students 'involvecf.* .*M ^ ' - .. . ■ \ 



. As shown in the following .sets of tables, .student apl^ievement declined the 

most in reading and. social studie"^ with- thev greatest apparent increase in ' 

- ^ , ♦ c% * 

mathematics. . . • • , ^-^^ 
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Table 1 " i^. 
Result Q of CTBS Analysis - Reading 
llth Grade 



Mean ^ 

Standard Deviation .. ^ 
PerC'Cntile < 
Normalized Curve Equivalent ■ . 
Normalized Curve Equivalent Gain 
N ■ - 



- Pre 

62.^99 
12.33 
*63 
59 



■ Post 

59.97 
• 10.48 

53 

51.6 



-5.4 
17 



t •\ ■ • 
12th Grade 



Pre 

69.36 ' 
66 

58-. 7 



Post 

/^8;28 
16.3 
^ 61 
. 55.9 
2.8 

17 . . 



Tablfe 2 ^ 

f 

Results -of CTBS Analysis - Language 

■ 

11 th Grade 



Maan » - • 

Standard Deviation " , 

Percentile 

Normalized .Curve Equivalen-t 
Nonn^ized Curve Equivalent 'Gaiii 



Pre • 



Post 



61.94 . 62.46 
10. 2^ ' 8.99- 

56 ' . 56 

5a;^2 53.2 

. 17 - 



( 



12th-6ra4e 



•Pre 



Post 



68.83 - 69.25 
14 .-41 . 12.-76 
68 69 
, 5^.9 60.4 
+0.5 - 
17/ 



Table 3 



Results. of CTBS Analysis - Mathematics' 



Mean ^ ' • 

Standard beviation 
Percentile. ^ ■ - ' 

Normalized Curve Equivalent 
Normalized Curv'p Equivalent Ga;ln 
N 



• llth 


Grade 


Pre 


Post 


67.58 ' 


72.36 


2i.V 


^ 18^72 


54 , 


„ 57 


52.1 


53.7- 



+1.6 

■ 17 • 



12th Grade 



^ Pre 



Po^t 



71.71. 76.19 
16.23 16.29 

'49 ■ .5^ 
49.5. » ; 52.1 
+2.6 

. 17 ,. 
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. Table 4 • a 
Results of CTBS Analysis - Reference Skills' !'-^ 



Me&i;* 

Standard Deviation 
Percentile 

Normalized Curve Equivalent 
Normalized *CUrve Equivalent Gain 
N • 



11th Grade 



Pre- 

15.25 
4.38 
59 • 
54.8 



Post 

14.48 
4.76 
56-' 
53.2 



J 



-1.6 

17' 



12th Grade 



Pre - 

16.06* 
.4.72 
59. 
54.8 



' Post 

'15*58 
/ 4.14 
57 

53.7 • 



Table- 5 

. Results of CTBS Analysis - Science ;; 

llth Grade , 

"! ^ 

• " Pre ' Post 




Mean 

Standard Deviatipn 
Perjcentile. ) • 
Normalized' Surve Equivalent 
Nopnalize^^urve Equivalent Gain 



26.66 
6.03 
67 . 
59". 3 



■ +2.4 
17* 



Table 6 



27.56 
7.32- 

IX- 

61, T . 



' Results of CTBS Analysis - Social Studies 



llth Grade. 
Pr^\ Post 



Mean . ' . • / 

Standard Deviation 
Percentile 

Nonaalized CurvelEquivalent 
Normaliz;ed Curve Equivalent Galh 
N 

• * / . - 

\ 



38.8 
S.5 

68 

5'9.9 




.8'. 9^ 
6.59 

66 

58.7 



-1.2 

*-17 



12th Grad« 



- Pre ' 

27.^83 
4.43 
66' 
58.7 



Poet- . 

26.77 
6.35 

60 . - ■ 
55.3 



-3.4 

17 



12th Grade 



Pre 

'30' 
-8.73 

■63 

57 - . • 
-4.4 

X 17 



Pgst 

28.01 
6.45 
55- . 
52.6 
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A commonly accepted criteria ^or estimating meaningful NCE gains is a gain 
(either positive or negative) or 7 points or -moire. In 'no instance did Project . 
REAL students increase^r decrease 7 or more points ♦in anv of the basic skill-' 
areas • T . 

Have Project REAL Students Increased TheTr Job Knowledge? , ' • . 

. > ' / ^< ^ ^ ' ^ ^ , ^, ^ 

Project REAI students', knowledge' of jobs as measured by the'* Assessment' of Careen 

Development (ACD) t;est dfd'not increase^ significantly • A pr/^test-ppsttest design 

utfilizing a comparison group of students, from Newark }ligh School (N^66) was 

employed. Although Project REAL students Job knowledge' tended to increase, 

comparable increases were obtained for the comparison groups' One^plausibl^ 

explanation may^be that the content poverage on the ACD was not comparable to * 

* • # * ■ * , 

individual student job exploratians^ conducted as, part of Project RSAL. Another - 

explanation may be 4:hat job knowledge .£s " influenced as a consequence of student 
maturation. , . 

■ ■ • ■ ... . . .■ ' ' ■■ ■■ ' 

Mean scores, standard durations ^^nd»N!s' for Project REAL* and. cojnparison; 
• students- 'for the -eleventh^ and twelfth igtades on the ACD^Job Knowledge test if^^ ^ 
found in Table 7. * . * ; - - * 



Table T ♦ 

'Results of Assessment of Career Development Test- J^b Knowledge 

\ 

11th .Grade 12th Gtade .Unweighted Means* 



Project FESr - Prb 



Mean ^ . ^ / '.•S5i>53 " 54.77 ^ ./ . 55.13 

Standard* Deviation , . 6.54 ^ - -er^l 

N ' 17 • . • * 13 ' 



Project REAL - Po9^ 

•< ; TT- ' 



Comparison - Pre 



Mean.. 57.53 . ^ ' 54.38 ' ' ^ , 55.96 

■Standard Devl,ation 6.45 ',- 6.72 .. . 



Mean 57.40 57.14 ,57.27 

Standard Deviatiofi .4.55 ■ . /■ ~ ■ 6.07 



N ■ 30' ' ". ' '36 

Comparison -• Post " , » 

Mean ' [ 59.70^ ^ , 58. 5d 59.00 

-Standard Deviation - 5.35 6.29 

N : • 30 . 37 . ; 

Unweight;ed . ". 

^ .Means - Pre 56.47 ' 55.95 "'. 56.21' 

. .. Pdst ^ .58.62 56.44, 57.53 



• ewv^ Table '8 displays an ' unweighted means analysis of variance fbir* post test 

■scores adjusted for prete,s,t scores. The data indicati alack of statistically * 

significant difference between "Project REAL Students; .and the comparison group. 

Also, there was no significant interaction between- Project REAL students' and -the 

♦comparison group and grade level/ There was however, a statistically " significant 

. ^ * - ^ % • » 

difference betweej; grades eleven and twelve. ^ *v ^ 

■ ' , ^ T , ; 'Table 8 ' ' ' • 

Unweighted ^Means Analysis of Variance for Job 

• . ' • • * ; Knowledge Posttest Adjusted for Covaria tes 
> • """^ ; ' * 

- '^urce . • Sum of Squares DF Mean ^Square ' F-Tes.t Significance 

* Project REAL/Comparison ' 41.72 v 1 . 41.72 ^ 2.639 p f O.108 > 
Grade^ll/12 • 63.23 ^ 1 63.23 4.000* p « 0.049 

^ Project REAL/Comparison 12.15 * ' 1* 12. i5 0.769 p^ = 0.383 

. . X Grade: ^1/12 ^ 

^ - " ' ^ ^ ^ ' ' ' " 

Covariates, ' . 4 1986.07 1 1986.07 Mfc5*634*** .0.001 ' 



Unit'^^f ' ' 1438.56 ^ 91 * 15.81 ; ^, ' ' - 

Although there were differences on mean pretest' secures between J^rojedt REAL 
students and the comparison group^ -when these differences were accounted for^^ . 
thei^e w3s nonsignificant difference on mean posttest scores. r ^ ''.^ 



• 




■ 


• ' f 


, ; ■• ^ 
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Have Project REAL S^tudents /increased Their Knowledge of Career 


Decision Making? 




Project REAL students knowledge of career 


decision making as measured by ^ the 




ACD test did not increase signif ic'antly. 


Comparison of pretest-posttest mean 




scores fot Project REAL students yielded no significarrt difference. Analysis 




of pretest-posttest mean scores between Project REAli students and the 'comparison 


« 


group also revealed^no statistically significant- differ^ce. . Mean scores,, J 




standard deviations and Us for Project REAL students* ai^d comparison, students \ ''^ 
^for the eleventh and twelfth graces on the ACD Career Decision Making Knowledge 




test is' shown ^ in Tabl^e 


9. ' 


* 


• 






Table 


9 






/Results 


of Assessment of Career- Development Test 








Career Decision Making Knowledge 




/ 


« 

Project REAL - Pre ' 


11th Grade 


12 th Grad^H - 


Unweighted 
Means 


/ 


Mean 

Standard Deviation 
N . . . 


■■ ■ 29.56 
, ■• 4,61 
17 


28.00 
?,29 • 


28,79 - " • 

1 




Project REAL - Post 


• * 






• 


Mean '.^^ / 
Standard Deviatd^on 
N 

Comparison — Pre 


/ • 28,82 
• ■ - 4.92 
17 


'» 27. is 
• 4v4-3 
.13 

* 


- 28*69 - . ' 

a 

\ . ' ^ 




Mean 

Standard Deviation 
• 


. " ' 26,77 
- " ' 3,01 ° 

. 30 . 


26,22 
r 5, =40 
■ 36 






Comparison -' Post 










Mean ' ♦ 
Standard Deviation 
N • 


• 26;80 
4,45 

' ' 30 


27.47 '- 

■■ ■ ^ 3.44 ' . 

,/ 36 


27,14- ; 




Unweigh*tpd^ 

Means. Pre 


( , 

• , 28,18 


« * 

« 

27,11 . ' 


. . .27*64 




■Post* 

• f 


"27,81 


./ 28.31 . 


28,06 * 


» 
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Table 10 shows an unweighted means analysis of variance' for po^t'test 



scores adjusted for pretest scores.. The ddta indicate no statistically sJigni- 



ficant difference between Project REAL students and the comparisan group /nor 
between grades. 'Also, there was no significant interactiorn between Projpct REAL 
students and ttie comparison group and gr^aiie level. 



Table 10 



Unweighted, Means Analysis of Variance for 
ACD Career Decision Making Kiiowledge Adjusted 
for. Covariates 



Source^ 



Sum Squares 



DF* Mean Square F-te'st 

1.11- 
1.29 ' 
. 0'.003 



Project REAL/Comparlson. -i 


• 15.45 


1 


15.45. 


Grade: 11/12 


17.94 


1, 


17,94 


Project REAL/Comparison , 
X Grade 11/12 

4 


0.04 - 


1 


, 0.04 


Covariates- 


339.43 . . 


• 1 


339.43 


Unit ' ■ ' 


' 1270.51 • 

*• 


i 

91 

0 


13.96 



Significance 
. p « 0.296 
,-nP « 6.260 
^p^>- 0.500 

24.312*** %'p < O.OOf 



When differences between mean pretest scores /for Prdject '}&AL. students 
and the comparison group were accounted^ for, there was no ^gnif leant differei\ce 
on mean post test sco.res* • ' 




Have Project' REAL students demonstrated successful completion of "at least seven 



compet;enGies? " > ' 

. • V- . • ' - / 

Pro'je.ct REAL^ x:'(^q:uires students to 'Con?)lete at; least seven competeifctes designed 
to equip students, j^ith "survival skills" needed for adult living. Successful 
attainment of- each; compel mcy is intended to lie certif ied'by a community 
representative* . The ^required competencies include; 

1» transacting business on a-'credj.t basis • ' ^ 
^ 2. completing federaJL and state tax returns . 

3, budgeting time and money effectively ^ • ^ 

4, operating and maintaining an automobile " / - 

5.. explaining one's legal rights and responsibilities ' 
6. paakiug appropriate use of public agencie^ * 

^ ' 7. j^ovidi'Qg adequate insurance for oneself, family and possessions, 

' * 

Project REAL staff have prepared materials describing the content of each 
competency, suggested student learning activities, and guidelines for ''determining 
f competency ^ttainipent. Additional revisions to these materials were jnade by ^ *f 
stUff in inservice workshops during the summer of 1977. * 

Examination qf the niomber of competencies completed, by students in each - 
of the. three high schools participating in xhfe project' indicated that the target 
criteria of seven competenoie^ per student was -not achieved.. Newark High school/ 
students completed six competencies and students in Glasgow and CHristiana High 
Schools completed *five competencies apiece. Moreover, intewftews with Project 
,REAL staff indicated that competencies were not 'typically certif ied' by^ community 
representatives a$ originally planned. Instead, competencies were certified by 
regular clan's room'" teacheis and in some cases project staff, a ^* 



Projeot staff rejxorted that insufficient^ time .was aVaH*a^)le for all student 

to complete at least' seven competenAess Project staff also' indicateci that. 

. thery were- reluctant to use community representatives .as ,certifieifs since cjmany 

them were already participating in the project as cooperating- employers/ 

.Nonetheless^, the^use of school personnel in lieu of. conmiunit-y representatives 

is a sigaificant shift in project plans. The philosophy 'of the EBCE program, 
' \ ' ' - , . •* ' / i *• ' ' 

Vhich^'Prdject REAL embraces, is rooted in ' the.jisfe of community representative3 

to provide "real life" learning experiences. .The transfering of th? role of 

' Jfe^ * ' ' w '/^ ' . ^ - ' f 

these r.epresentatives to school perso^ejl diminishes the emphasis on community 

• - * ' * ^ ' 

involvement. However, plans ft^r Pr^Vt REAL's second year of implementation ^ 

. , , - - ^ . ■ 

require that at 'least sorae rompep^ncies will be taught and certified by 'com-, 
munity representatives. >^ ,'7" * . " - , • 
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'Conclusions -^f , ' 

The findingV of the previo^as section support attainment of Vne'of the four 
student outcome objective's. Project REA^ students overall maintained their 
^ Standing compared to ^the ^national norraing sample* in the basic skill areas. 
;^ Although there are some increases and decreases in the b^sic , skill areas, - 
, involvement in- Project REAL appears not to have had a significant influence on - 
student achievement ip thes3*^reas. In the areas of job knowledge and - ' 
career planning knowledge, ' Project REAL students performance tended to 
Improve, a 'small amount between pretest and po^ttest ladministratiori,' however, a 
'compcafi^ble increase was also demonstrated' by the' comparison "group. Thus, one 
capnot attribute Project REAL student performance to ^rojict' activities themselves. 

Project REAL did' not attain the target criteria of a t\ least ^ven competencies 
completed, by each student. Newark High Schooi students consisted six competencies 
each while students in Glasgow and Christiana complete4 five competencies. Also, 
regular claissroom teachers in e'ach of the three high" scho^ols were 'used in some 
, cases as , competency certifiers .In' lieu of community representatives. 



Several Issues, however, preciad€>drawing unequivocal conclusions about. 

the absence of l>roject effect. Fir^<"the low level of validity and reliability 

of instruments in the field of career education works against precise, measure- 

ment of -Career \ducatioji attributes. Secondly, because of the time required 
* >■ • . ■ " • ^ 

to gear-up for fiiie project, 'restriction of the pretest-posttest period to 
• less than six .months may noc have given sufficient time for the project to ' , 
produce measureable effects. .And last,' the relatively high mean' pretest'scores " 
may have had a^cieiling effect on mean posttest scores and' therefor4''f,estricted 
, -achievement as ;measured by the .ACD instrument. , ^ " 

- ' V,.. ' - ~- . • ■ : ■ J ♦ 
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Th0' findings' suggja^t that the ACD instrument may not be the most appropriate 

.lilstrument for use in measuring the growth of career education attibutes. 

' ' I • I • , - 

.therefore, ' it is recommended that an investigation be undertaken to ident;ify 
'an altetnate instrument. It is also recommended that strategies be d^v^il^ped 
and employed to secure co&nunity representatives as competency certifiers for 
school year 1977-78. ' . ' i ^ • . 



•SECTION III. PROJECT REAL* STUDENT PROCESS BVALlfATION Q^jfeSTIONS 
Have- Project REAL Students Been Placed in Community -Exploratory and Pro,1ect 
Learning 'Activities? * ' 

Project REAL program specifications require that students complete at least 
thiree exploratory experiences and five projjects. Career exploratory experiences 
are three-'to-f ive days in length duriiig which time- studenCs^-interact with 
adult members of the work force in occupafions of interest to students. 
Projects are ionger in length, typically spanning three to five weeks, and 
provide .the opportunity for studen<ts to study occupations of 'interest to them 
in depth. Projects .arre individualized and incorporate academic as well as 
* occupationally related areas. Bocfc'i^xploratory and project experiencies are-*' ' 

characterized by direct student conJtac<: with the tools^ materials and other 

/ y^^' - . / , ' 

resources available. in community wptksites. - » . 

^li ^ ■ ' r . . ^ . 

The dat^ collected from Chr;4s|iana, Glasgow and Ngwark High Schools . 

' ' ' * ' - L- , ' ' • : - ' - ^ 

indicated that students achieved tpe target criteria, set for the completion 
of exploratory and project expediences. Takle.ll' displays the numljer'xjf 
students attaining the target critferia* * . 

* . - ' ' ' Table 11 

* *^ Numb*er4of Students ^Attainin^'tJriteria for- Completion 
' , , " of Exploratory' and Project Activities - 

Project Sites * Exploratory Experiences - Project Experiences 

Christiana HS - ' ' ^10 ; iq 

Glasgow HS" , - • , ' / 5 ' L \^ i.-.^ 5 

Newark HS ' igi^ 19 * v \ ^19 "" 

Totals . ^ \^ ' ' . ' ^. ' 34 
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• \ Project' REAL students ^d'cominun4,ty exp^ience^'s ln^^alj>rrai^ array of jobs 
or job clusters. Table 12 presento^^jjj^^ of studeints completing career' 
explorati9ns and projects Ijn each of* the follt5wing jo^luste?^s: ' 



^Table 12 ^ 



Distribution of Project REAL Students irj^Job Clusters 




Job Cluster , ^ '° 

. 1; Agri-Business and Natural Resou-ycW 

2. Business and Office ^ ^ 

3* Conmiunicattons and Medja 

4. Construction 

5. Consumer/ and Homemaking Educat^ 

6. Environment 

7. Fine Arts and Humanities 
^ 8. ' Health . 

T 

9. Hospitality and Recreation 

10. Manufacturing" 

11. Marine Science 
'12'.' Marketing and Distributioij^ . 

13, Personal Services 
14* * Public Services 
15. Transportation^, 



N Students 

4 • 
18 

•5 

' . 4 

•3 

' ' 5 
1-6'' • 
. 5 , 
3 

« 

1 
. 6 
18 

. 19 



The data in Table 12 indicates that Prfrjeet s-tudehts were placed in jobs' 

chat were distr^.buted across the U,S. Office of' Education's fiffeen iob ♦ 
5ters, ' ' 




X. • U.S. of flee of Education [Fifteen Job Clusters 



Learning Site Analysis Forms -(LSAF'.'s) tiave been prepared by Project REAL ' 
staff for each community Work site, ^.LSAF*^ include a description of the 
materials, tools, equipment and job tasks^ students may encounter at each site. 
LSAF's are us^ to^ develop specific site learning, objectives that in turn are 



njped'in developing student projects. . , ' v 

f ^ ' i 

Review of a« representative sample of LSAF's (N=20) in^ i^cit.^ -fehat tK^se^ 
foi^ms'-have been completed satisfactorily. Specific job tAsks have been de- 

. " • • . . ■ , , ' ->vA . ■ ^ 

^^^^ineated; tools, materials and other resources available at the work site 
identified; and an Qverall des(iription of the job are included in the LSAF's. 
In many ^ns.tanc^s however, LSA^^'s were completed without face-to-face contact 
with job representatives. Project staff reported the LSAF*s< demanded an un- 
reasonable amount of time to complete and that telephone interviews -with / 
'Community representatives^ were used in lieu of ditect ^contact. Nonetheless, 
the lack of direct cqntact with community representatives may influence the 
degree to which LSAF's" reflect job site jjactivities, • 

In adctLfibn to LSAF's, Project REAL has also prepared an#Employer' s 
Agreememt Form thap describes the terms and conditions under which the employer 
agrees to participate in providing job experiences for students. 
Have Project REAL Students Been Awayded Credit tbwatd a- High School 'Diploma 

for Successful Compl^etioji of Program Activities? • > ' . - 

\ ' . * ' . . *' 

> : . y ^ 

The Delaware State Board jof education and . the Newark Schbof^District. have 
established: gfiidj^lines regarding the award 'of credit toward .a high school diploma 

for students pursuing^ ^lterndt2lve secondary educajfcoMl programs. The State 

/ ' T , ' ' ' ' 

Board of -Educat|.on and the Newark School District require^a minimum of 18 * 
^approved credits ,to be awarded .a* high school diploma. 



* • ' , State land district policy provides for: "i.,the granting of 
the maximum of three credits ^toward graduation for a eombinationi, 
.of approved and individualized programs which include: irxdepen- 
- dent study, ^ojects arranged ^ith appropriate scjiool^administrators ^ 
and staff persons and approved and superjpfed work e^xperiences' In 
the scTiool and community wfilch' meet the educational objectives (&r ^ \- 
.special career interests of an individual student,"^ ' ' • .'i • 

• . > .• - ■ ^ . ■ • ■ • 

Nonetheless, all project REAL credits can be applied to the 18 mlnimain ' 

' ^ • • . .• ■ -isJ ^ - ^ 

. required for graduation, additional oredits for Project "REAL -pro jiqCs. were 
awarded*' beyond- the 18 credit minimum, to insure that each student, received > 

' ' . ^ ■ • • . ■ 7 ■•• - 

appfopriate acad-emic credit consistent with the time spent 'in Project REM.. 

' ' . • *''.■'/,■ 

One-half credit was awarded for each project complete'd^with additional credi-t — 

/ ' * 

awarded for successful completion of career competencies And explorations. 

Project REAL staff developed and distributed to- sti^eii^ts and their * ^ 

parent's guidelines for -the award^ of 'credit for participation. in the project;^ 

ETS staff reviewed these guidelines and supportive fortas/and other documents . 

and monitored ^.there use/ Altl^ough each of the three irbject sites have 
• • ' : . 

particularized. guidelines for awarding credit, there/wds, a high 'degree of 

consistency among, the sites in "applying the guidelinea^/ ' ' ^ ^ ^ 

^ * ■ . - - ' r * / ' . ' 

Interviews with s-tudfehts .in each of the projedt /sites indicated that they ^ 

I . - . ' , f *i ^ ^ 

^"fej.t the guidelines arid procedures for awarding credit were reasonable and 
equitable, ^Although project st^f f reporteti' that the guidelines were appro- 
priate, they did eaylrhat the. process' of iiiterpr^ting pro'^ects in terms of 

' the' academic atea the credit should, be granted was a difficult and time 
consumi-ng task. During the summer of .1977 project staff reviewed the guide'- 
lines and made revision where necessary, ' ' ^ * 
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Project REAL Imp lem4nted Sex-Fair Guldaofcig, Placement /.Caungelln^'^ 
Follow-up Services? 1 ' .^i ^ 

Project REAL has .prepared! a comprehensive g^an^ for dealing with se^x bias and 
sex, discrimination issues that relate to 'tlie project'.' ihk plan^lnclude's : 
; Staff development activities' to' familiar-j.zl staff Vith sex 
bias and sex 'discrimination. issues in career education. * 

• Strategies and pr-ocedures tor dealing w±th these issues^- \^ 

^ . Vnta stiidentf level-.' , ^ ' ' 

^ ' r Studient. process objectives in guidance and counseling. 

Guidelines foh the ^election of non-textbook materials. / 

• Guidelines for dealing w^.th controversial instructional 

* I * •' . ' * ' 

^ . * materials.* I ' . • * ' ' / 

• Checklist for evaluating ra^tefials.,\^for radial and sex ' > * 
' .discrimination. . , 

• \' ^ ' . ! ' ' - * ^ - . - 

The comprehensive plan for treating sex bias and seX' discrimination 

* ' i' 

issues was developed late,' in the Spring' of 1977 'and Is scheduled for imple^men- 

tation in the school calendar year 1977-78. During the project's first six 

. " ^ . ^ ^ • ^ . - -..^ 

^ months ^ of operation specific instruction in the irea of seK bias and sex 

- discrimination was provided to students by^ Project REAL staff on an ad hoc 

* * » -t * 

basis <• " , t 

* 

Project REAL ha^^ also developed and implemented , a student placement and — 
fo^llow-up system to account for^the educational j.^b placement of each- student' 
who graduates Ijr leav^ the project." Table 13 summarises student placement 
and follow-Up data across the three project s.ites. , ■ 
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Table _ ' . ■ ■ ' -.■ -.-^L- 



•Project REAL Follow-'util Information 



• 



\ Grade 11 ' ' ' , 4rade' 12 



Total NiSb^r Enrolled in Project REAL '/i' * ' . 27 25 

Graduated — Enrolled in College . '\ ™ . , -10 

-Gr^ated'-^ ^\aced in Job ^ ^' , ^| „ \ * • 8 

Gradu§ted ~ Not' placed in Job or .College- * ' — ^ , * 4 o 

Complete.d program and promoted v: ,'. li - * ' 

..Dropped out of Project REAL ^ and' 13 * ' 3 

Returned to regular classroom - ^ * • * ' ' 

Dropped*out »of school • - • * — . ^ 

• • »■ • ^ 

Transfered out of District • ' '^2^^ - ~ 

'Re-ejprolled iif "Project REAL for secondrryear . ;- * 1 - \ " , ' ^ t — 



1? 



' Has Pro,t'ect REAL Implemented a .Student^ssessmeiit Program? 

Prpjec;t REAL has implemented a studen^ assessment pr'fgram .in the basic skill 

^fea^ and ckreer development. The California .Test of ]5asic Skills .<CTBS) and 

the Assessment of Career Development^? (ACD) instru^vent wer^ administered to 

al]^ incoMng 'project students. The/test* results^ were used by project staff , 

in' developing •'individualized .learnj.ng plans (i.e. projects) for students. 

The subtests co/ered by the-*CTBS include: ^ * ^ 

1 . Reading ^ \ . * . ' - * _ 

2'. Language > - - 1 - . : ■ ' 

3. Mathematics • , - ' < ^ * 

''4 * 

4. - Reference , Skills ' ' , * 

, ^ * ' f . 

5*- Science * , ^ * * • 

# 6.- Social'^'Studies - . * ' • . 



laterpretation of test scores for instructional use is based on comparison 

with the OTBS norming sample ♦ , In those instances when students score below 

the 50 percentile in '.a particular basic skill area; individual learning* pl^ns 

are prepared to offer students special ^instruction in this area* 

• • - • > 

In ad4ition to the use of the CTBS on a pre-entry assessment basis, the 

results of the CTBS pretest-posttest analysis were klsp used by .Broject REAL 

staff to identify specific parts .af the tes^'^that- s^tudents tended to do 

poorly". An item analysis of the CTBS hars been d}>ne by> Project staff to 



identify' 



content areas ^of the. test where student achievement was less than 



anticipated/ The results of the item analysis was then used to develop 

individual learning modulfes ,<e»g. computational skills, r^adihg) . Plans , 

call for incorporating these modules into student projects xjuring. the •Projecjt's 

* " * ' * ' ' I 

second year of operation ^en^ thB results of students pre-assessment indic^es 

low achievement .in a specific basic skill area/ • ' ' 

The results of the ACD preassessment was used by Project REAL staff i 

primarily as a dfevice to identify students* interests. ACD results and /interviews 

' m ^ . ' I 

'with students 'conducted by Project staff were u^ed to select 'careeY exploratory 

I ' \ ^ / ' 

e'Xperience that were of most, interest to student^. ' The ACD pos,ttest rejbultsj 

were used by staff in a similar coikseling, manner with students to dls(^uss how 

interests, in careers or occupations may have shif ted>s the result of fcartici- 

pation in Project REAL. ' ' . ^ 



Conclusions : 



The ^findings, of this section suggest that Project* REALMS student processes 
activities") ha\5e been implemented as planned. The da^" colleoUed 



•.indicate tlS^f project- students have completed the required number of 
atory experiences and project experiences. Also, an analysfa* of tfie. 



explor- 

» 

career 



explorajtion^ and projects indicates that Project REAL studerJt-s. were exposed 

* * ** • 

to a broad array of j'obs or, job clusters. Learninjg Site -Analysis Forms (L^AF's) i 

Mve been prepared by'Troject REAL §taff f^r each coimnuhity work site.- 

However, in many cases, LSAF^s were completed without direct contlct with job 

representatives. This arrangemeHt may have an unknown effect on the extent: 

• • . * 

to which^LSAF^s re*flect j'qb site activities. • • - ' 

Project REAL- students have been awarded credit toward a high school diploma 

in each of the thjree ^project high schools in a mariner consistent with published t 

guidelines and policies. A comprehensive student assessment program has been 

implemented and is utilized by project staff in the^preparation of individualized 

student learning experiences. An area in which Project REAL "has not proceeded 

in a way consistent with its'stated plan§ is reviewing project related materials* 

for po^ible. sex-bias. Although, student process objectives 'have been developed 

in this area -and materials have been selected to review project materials, a 

systematic set of procedures have 'not been developed or implemented in this 

area or concern, • ^ 

« ^ ^ 

Recommendations ^ , . 

The fallowing recommendations are based on the -findings that indicate .that 
improvement is needed in the preparation of LSAF*a and in. reviewing materials 
for sex-fairness: * » . ^ • . 

^' • . ■ , ■■ ' 

1. LSA? should be developed and prepared incorporating diMct contact 
^ with employer • representatives . - • ^ ' • 

2. A set of procedures should be developed and inq)lemented for systema-^* 

* ' . - / . e ' • * ■ ■ ^ 

^ tically reviewing all- project related materials fot sex-fairness. 



^ SECTION IV. PROJfiOT, mi MANAGEMENT PROCESS QUESTIONS 

Has* an Overall Project "Management Plan Been Developed and *Iinp lamented? ^ 
The director of Project REAL has prepared and implement.ed a .management plan that 
inclucles the following elements: " /' , ^ « • 

• ^ Goal Statements ; A description the broad goals of 

r • Project "REAL/ ' ' ' - . " ^' 

• Objedtives r A description of the \Qbjectives related *to»each of 

■ / ' . ^ ** ^ ^- - • . - 

' -the broad- goal statements, ' • - 

. • c-# Activities ; A description of the activities designed to 

V * ' * • 

accomplish the stated goals and objectives,- 
. • • Completion Dates ; The planned coiripletion dates for accomplish- 
ing each of the stated goals and objectives, 
I ' • Resource Allocation ; A de'scription of the human and financial 

/ resources 'allocated to each of the goal and objective areas, 

*• * - • 

Person (s)' Responsible ; - The name(s) of the per8on(s) responsible 

for undertaking project activities, « ^ ' 

Ansftysts and review of the management plan indicates that project goals and 

objectives have been linked to proposed project activities, start and completion 

dates have'been established foY each of th^se^ activities, and financial and 

human resources have b^en referenced to .each of the project activities. 

Has Parental Approval for Participation in Project REAL and the Third-Party 
, 

Evaluation Been Collecte'd for Each Student in the Project? * 

Parents of .students; expressing an interest in participating in Project REAL 

■ ^ • . ' • , 

were informed concerning the r-equirement £or prior parental, approval for 
Students by laail and during an orientation session.^ A checklist procedure w^s 



developed and implemented by the project's staff to insure that parental approval 
was secured prior to student participation. ^ 

Student folders were prepared that contained .the following forms:' 
parental permission, insurance, acc-ident, and transportation/ An ETS repre- 

• sentative examined each student's .folder early in the Fall of 19.76 and folund ' 
that a signed parental permission form and other necessary forms were present 

, for all Project REAL ^tudents. Further examination of the dates of. the parent- 
al 'form "revealed that pennission h^^d been granted by parents prior to student 
involvement in the project. ♦ ' • . • ^ 

Have Provisions Been I mplemented to" Guarantee the Safety ' and General Well 

. Being of Project REAL . Students? ' < ' 

Insurance protection for Project REAL students "^as provided^ through student" 
part-icipa.tion in the Newarkjchpol District's insurance plan ox through 
individ^ual family coverag4. Students utilizing private vehicles for trans- ' 
portation to and from schQol and community work sites were also required to 
demonstrate adequate insurance protection "of - himself /herself , the vehicle 

^ and passengers. Students Jzransported on District owned and operated vehicles ' ' 
wel^ covered thrbugh the ^istrict's insurance plan.' Also,_ liability insurance ' 

■S^otection for employers involved in Project REAL was provided by the District.! 

, Examination of student folders indicated that all of the students'were enrolled ' 
in either the District's ^ar their family's' insurance' program. 

-Trojecfc REAL on-aite femployer work activities were of the non-paid variety 
and were designed to be in ^cor^liance .with, the child labor provision of ' the * ■ 

.Fair Standards Act. Also, la copy of. Project REAL's pru)po8al was submitted to 
the Area Director of the .Department of Labor to inform the Director of .Newark's. ' 

» . r ' * * * 

intentions in implementing .Project REAL. , ' ' • 
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What Was, the Nature of Project ^EAL, Staff Development Activities? 
' A variety of staff development activities w^reXprganized by Project REAL's 
• director. These include such activities as: X ' 



1. The Newark School District's subject area supervisors (N»10) 

'.attended a half-day orientation session, abput Project REAL in 

September' of 1977. The session , was- conductjad by Project REAL's 

• • * 

d^.rector and covered ,topics such- a^Nthe philosophy, goals and 
, objectives of Project REAL, the relationship between Project 
REAL and other district curriculum offerings and uhicjue and 
special axrangements that were necessary to implement th^ project 



in the district. 



2. Project REALMS staff (N=6) attended a one week training sessiqift' ' 
\ ccJnducted- by Mr. H.- Ferhenbacher , a representative of , North l4st 



Regional Educational Laboratory. The trainjng session cover4d 
a variety of subjects including recruitment of students, u^'^/o'f 



project form? and other materials, student assessment, identifi- 
cation ana selection of employer work sites and numerous .^'thers ; 
administrative and instiructional aspects of the project. ^-? 



"3. ETS staff conducted a one day workshop for Project .REAL Mtaff;- 
^ early^ in the Fall of 1976 that -dealt with the role of t^^^ 

' ' ' V ^ ' - 'K" ' ' 

Ifihird-party evaluator and student, assessment. ETS's evaluation 
design was- presented and discussed with the aftaff, as ii^lll as 
the staff's rqle in administering the pre and posttest^'knd 
s other data collection activities. . * ' -^U:* 



- ■ \% 



• • 4« During the period. of September to December^ 1976 the staff of. 

Prdjeqt REAL dfevelopedJfcpecif ic project materials and , * 
r^ecruited students employer sites necessary for implemeating 
the program in January of 1977, " 

C » 

5, Project iCfiAL staff attended bi-monthly staff ^m^etings -irom 
* * / . * ^ * 

January to, June 1977,. These meetings were held .primarily to ^ 

• resolve daily operational problemis .effecting the implementation 
of Project REAL, ^' 

6. During the Summer of 1977 Project REALMS staff revised the * 
following materials: basic' skills competencies, operational 

* manuals cantf-^g^d&lines, and a^ wide-variety *of mis9ellaneous project 

forms, * % * • , . 

Each of Project REALMS staff worked appro^^imately seventy hours during^the 
summer months pn project relatejd activities, While^ project staff were involved In 
revising materials the p^ject^s director prepared a comprehensive staff 
development plan,** incluj^ng statements of objectives and activities, for 
implementation in the project** s seco'nd year of operation, , * , 

* ' * ' . * • 

Has the^Necesswary Project Staff Been Employed jff Keeping with the Project^s 

^ro£osal? • " - I ^ 

The following personnel, have been employed and are {Present at each. of the* , 
three Project REAL sites: one learning manager, one community coordinator 
and one clerical assistant, ^ full-time project director has also been empld^pri^ 
and- is located in Newark School District's, central office. Each of the staff has 

been provided .with a job description listing the appropriate tasks, roles and 

. , . , ■ ; . ^ 

responsibilities, A personnel review-procedure has feeen implemented to ensure 
.periodic evaluation of all Project REAL personnel, ' 
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Has a Project REAL Advisory Board Been Established? . 



The .Newark School District has 'maintained for the past four years an external \ 
career education advisory c;ouncil that was established as part of the district's , . 

involvement in the Career Educational Instructional Systems Project. The 

■ ■ - . . . ^' 

council tneets monthly and its membership includei§ reptesentatives of -business, 
Industry, state and local governments, state education agencies, and a variety 
of proiessiQns as well. The purpose of the council is to advise the 

sup^riiTtendent on broad areas of concern in the field of career education and 

J ^ e * 

to establish a basis fbr community support. Because the council continues 

to meet on a regular basis a decision was made in early September, 1976 to form 

a subcommittee or task force *of the council as an advisory board to Project REAL. , 

The Project, REAL Advisory Board meets every other month and assists the^ 

project direct'or in program planning, establishing community relations and 

shaping Project REAL policies. Agendas are ptiblished 5 days prior to board 



meetings and minutes are prepared, and distributed following each meeting. Minutes 
\yf each board meeting are included in Project REAL quarterly reports.' 

To What Extent ^Was Project REAL Implemented as Planned ? 

Learning /Centers ; Xearning centers have been established as planned in each ^ 
of the three Project REAL sites. These centers are located in classrooms and 
have sufficient desks, file cabinets, audio-visual, dupl;icating equipment and 
4 other paa'terials and supplies to function, as a self-contained unit. A single 
Classroom in Christiana and Glasgow High Schools has been designated -as a 
Project REAL learning center. However, due to increased enrollment in Project 
^ RE^in Newark High^School next year (i.e. 1977-78) three ^classrooms have been 
set asidSl^for Project REAL's use. * . . , • 
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Transportation ; Transportation of ProjUt- 'REAL students^o and froIn^ worksites 

^ ' ' ' « 

appears to have not been a significant pypblem. .Unlike other experience- 
. » * ' • . * • 

basfed career- education projects, Project ;REAL requires that students make 
arrangements for their own transportation. However, although staff and 'student 
did^not report this as a problem, it mly be a self-limiting mechanism that v 
prevents expansion' of Project REAL in^those instances where pubUc or private 
transportation may not be available to some studentss wishing to enroll ^in the 
project. ' ♦ ' * / " • • 

';<^ .'I _ - ; ■ , . ■ . ■ 

Community Work Site/ : The staff oj Project REAL have^identif ied in excess of 
90 community work sites. The wqrk experiences found in these Sites represent 
a broad array of jobs and job clusters spanning the 15 job clusters classified 
by USOE. ETS interviewed a representative sample -of , five employers who par- 
ticipated in the project during the Spring of 1977* The employers interviewed 
uniformly had positive teacylons to Project REAL, expressed an interest in 
continuing their involvement in the project and thought that Projedt REAL pro- 
vided students witjh first hand experience of demands in an employment setting. 

Project REAL Site- Characteristics - ' ' 

ETS -administered the Implementation Site Essential Characteristics Checklist 

• A> 

prepared by NWRELjs experience-based ckreer education' staff to a33ess Project . 
real's site characteristics* The findings of the Checklist vindicate that 
Project- REAL: • , ^ " 

• provided individualized instruction to students . * 

• utilized- community resources as a basis for instruction 
> ( ' . . ' ^ ^ s * ' ' 

, • built on career related^ activities of adult members^^of the 

Work force- • * * 

• represented a comprehensive and integrated educational program 

• focused primarily on the career development of - students * ^ • 



1. Refer .to page 19.for a list of student work experiences in each of the . 
15 job clusters. - ' 0/l» • ' ' 



Comparison. between 'these broad findings and P,roject REALMS first year 

, , • '♦^ t» 

proposal and its maftagement plan indicate that^ Project REAL exhibits the' 

es9^tial characteristics 'of an experience-ba^ed career education project. 

;^ The completed Implementation Site Essential Charactftristits Checklist is*- 
^ ^ ' *' ' ^ \ ' 

contained in Appendix A. ' . i ^ . . ^ 

Conclt j ^ions ; * 
Examination of the management process evaluation' findings indicate that Prolect 

REAL has been implemented as planned during ita'first year of operation.'. In 

-> ' , ^ * * 

byief, an overall project management .plan has been pr^par«d and implement^exi, " * 

parental permission has been secured for students participating in the project 
and provisions have been made to provide for the general safety and well -being 
of students. Project staff havfe been employed consistent with the project *s ^ 
original proposal and A variety of inservice fftaf f development activities have 
been undertaken this past year. An Advisory Board has been established and 
functions as a sub-committee of Newark Scliool Distrlc<:'s Career Edfication 
Advisory /Council. Bimonthly board meetings hav6 .been held and agenda anj^' minute 
of these meetings have been prepared and circulated to counc^Lmembers. ' 

^Also, in excess of 90.community work sites have-.been i<jlfftified, learning 
centers Tiave been established at each jof the three. project Sites, and the. 
administration -of the Implementation Site Essential Characteristics Checklist 
-indicate tha;: Proje^^'^REAL exhibits' those char^cteristi9S -considered to*b^ - 
representative of experience-bas'^d career education programs. 
Recommendations : * « . . 



Project REAX^'s first year of implementation has occured'' without significant 

• * < * • *■ 

^"^iw ^"^^.^^^ consistent:' with 'the project*s administration and operational 

plans and intentions! . / 

• Therefore, it. is recommended that the project director follow the same 
procedural steps in' preparing^ and implementing^ management plan for Project, 
REAL for its -.second' year of_operation. ' . -^ - * 
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Site NatPo Prn-)ert RRAT., Newarklschool District APPENDIX A 

■ RcstJondcnt Namr- Dr„ Prlmo Toccafondi ^ ' , ■ . ♦ 



\Obscrver R.G.. Wasdvke." Proi4ct<Evaluator ' 

. Date May 3.\l97J • ' . ' • " , . 

' lamentation Site Essontial Characteristics Checkli st , / 

I ' ' ' — , ' <j 

For each area, rate the siti2 on a five-point scale with the anciior points 
' on'^ the s^lPle indica-ted. 

I. EDGE IS an Individualized program 

A. Ongoincj assessment of ^tlident needs, interests and abilities in Basic 
Skills, Life Skills ^nd Career Development ' '\ 



rn There \ 



5: 



lerc IS ng ongoing ;i$sGssment in two or m.ore of; these areas/ ' 

Tji Studort r.eeds, interests and ahi^litie^ are continually assessed 

f ■ — ■ 

.B. Participation in assess.-n^nt • . ' • 



E students play a passive role in the assessit^bnt process 



Students play ar^active And invo.lved 'role in the assessment proc-s^ 
/ ' -J - . . . - . . 

Individ .:aLi*ne^otiation ' ' i » , ' , 

— \ • ^ ^ 

lIj All project^ are pre-assigned and npt subject to' negotiat ion 

l^j-- All -projects allow for negotiation between .student and learning 
'manager- - 



D. " Integratior 



-Th,ero IS no ,formalize<3i^ individual assessment and/or accountability. 

[5] Individual assessmdn^ and accountabilit:Jr,. are , integrated with 
. , * prccrant learning strategies v/he^n learning 'plans are* negotiated . 
' . ' * ' • * . 

Accountability standards «( set^of learning arrd behavioral expectations 
for students as n^ember^ .of the EBCEc 'community*'") - ^ * " " 

fr] TH'erc are few accountability, standards^ ' • ' 

[5] Accountability standa,rds* give the studeht the necessary flexibility' 
to meet basic progr^nx expectations* 



II. . EBCE is a Community-Baaed ptq^ram ""^ 

A. Community input into program planning aftd- operation 



[T] No mechanism currently ekists 
[3] A systematic mech'anianv'ex/sts for p: 



Q ]5j A systematic mech'anianVexists .for procuring and utiliiS!^~q cbnununitv 
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^ ^ District career Edqcation Advisory Cpuncll ,^ - 

B. Role of the program advisory, boa'rd . . ^ ^ . * . > , 

? Q There is no program advisory board 

^ |T) The program -advisory board tak'es- an -active role in direction of ^ • 

the pVogroin by pz:o/iding program input ^ 

* C. Comlnunity members and student lear.ung 

]Jj Community member? are not involved in student learning activities 

"5"^. Community members serve as resource instructors and certifiers bf 
• student, learning . . ■ ' - 

D Provision for emf-lover instructor training/development^activitics- 

Not done There are no employer instructor training/development activity eb . 

I ^ ! ^- , * '* *^ 

T There are at' least four, regularly-scheduled employer instructor ^ . 
training/development activities . ^ ^ 

III. EBCE IS an^ I:>.periencG:-3ased prpgran and is buiTt'from the career activities 
of admits ^ - ' 

' . A. MQde- of learning » 

Studcntd arc instructed in a passive or school-like mode / 

S, -i ^ - ' . . ' . 

rs Acti'-e, realistic lifelike learning activities are provided for 

all students < ^ ' > - 

3. Student act^viXy ■ , . - . • 



ERIC 



students are'' assigned activities and.^schedules - * . 

IT" students have th'e responsibility for budgeting *Jtheir -time and 
* managing their daily activities » ' 

C*- Utilization of resources ^ . . . . - 

' [ij Secondary r6'3ources (text^oks, courses)* are given^yiority 

[Sj Primary reso.urces (people; institutions/ such as libraries and, , 
museums;- events) are given priority ^ ^ ' * 

Community learning activities . ^ ^ " ' - 

Qj Adult activitles>Ln the community are not Utilized ~in student 
.; learning / . ' / . • ^ , ' • • 

[5] Adult activities ' . the community serve as the primary context 
for student'lec' \g ' \ - , 



IV. 
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E. Reference population * * . 

d] Adolescent peers anH school work are the primary referrent 

\ A^^lts in the. world of work are the primari*ref^»p?^t 

r. Community learning potential / . * , • • 

No analysis is made of the learning potential of the local 
r/. * community ^ 

_4| : • ^ s 

[5] There is systematic analysis that enables st^'aff and students 

to fake full advantage of th/ learning potential of the local 
corSmunity 

EBCE' mast have its own Identity and must be Comprehensive and Integrated 
A. Prograr requi;:ements and orocesses 

'V • ■ • - " ' ■ ' 

-^1.1 Regular ^^i^^ school requircnients and processes are used to 
; determintTstudent learnir.g plans 
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JT^ ESCL : rogram requirements and processes determine student 'learning 
plans. - 



B. , Progreun completion requirements 

c ■ LU Progr^ completion 'recuirf^r.ents are Vaaue, unspecified or not 

• r4 - differentiated fr^m the regular high^chool requirements 

[5] Program cToT^pletion re<5uirements are clearly defined, differentiated 
from and consistent with program goa,ls and local requirements 

C. Curriculum , ' - * ' ' . , 

d] The, curriculum. structure includes experiences in either one or* 
none of the following areas : basic skills, life skills, career 
• • development^ 

"^"5 3] The curriculum structure includes experiences in all of the^^ove 
axeas' ' " . » - • ^ 

D. "Survival competencies • * - 

' iJL Tl."i^re are no performance-based survival compGtervcies " 

[S_^ There are at least- ten performance-abased survival competencies-. 
. , ' necessary for^ coping -in- life and modern society' , 

£. .Interrelatedness of curriculum areas^ and student learning 

^ lLi Disciplines .are en^hasized separately, 

[5j Emphasis is on interrelated curriculum areas and this is 
" demonstrated" by the student learning activities ' 

ERIC . , , V qo • . • 
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V- The EBCE program, places a major emphasis on the Career Development of 
students • ' \. 

A. Types of community learning situations. '4 •>> 



tij There, are no employer/community learning sites 

Provision is made for dif ferent ^ types , and levels' of le/rning 
situat;ioi\s at employer/community , sites . - 

B. Emphasis at learning sites " . ^ 

(Tj Students are paid for theii* contributions on employer/community 
• • ' sites , ' ■ ' ' . 

|T students are on employe r/cotwnunity sites for learning about ' 
careers, n.ot earning -money ^ . ' 

C. Career Decision Mailing - - , . 



I 



[Ij Students are. not encouraged to^improve their career decision- 
; maki ig process ' > * 

[5] Students arc required to gather, information about fhemselves 
' and the world of work and apply this .information xn career 
decision - making . 

Reflections on student experiences 

E There are ho 'requirements towards self-evaluation- 

[5j Stud'ents arc encouraged to reflect on student: expterienccs " and 
evaluate their own strengths and weaknesses a^d progress 



t 
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